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5.1 Statistical approaches. 

















5.2 A proposed statistic for preattentive texture discrimination . 

5.3 Detecting texture boundaries . 

5.4 Summary. 

5.5 Comparison with other theories. 
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Chapter 1 Introduction 
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surface orientation as well. Stereopsis combined with surface interpolation can 
locate depth and orientation discontinuities (e.g., Terzopoulos [1985]). Color 
is useful for distinguishing material changes from other types of discontinu¬ 
ities (e.g., Rubin & Richards [1982]). Structure-from-motion can find occlud¬ 
ing boundaries (e.g., Hildreth [1984]). Multiscale intensity edge analysis may 



provide some additional cues for interpretation (e.g., Richards et al. [1982], 
Beattie [1984]). 

Table 1.1 summarizes the kinds of discontinuities which various vision mod¬ 
ules can identify, ignoring specularities and light sources in the scene. One 
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^harniak and McDermott [1985, Figure 3.57] tabulate the inverse mapping between 
columns two and three, namely, the kinds of discontinuities which can occur at each type of 
physical boundary. 
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The first of these representations is the raw primal sketch, a representation 
of intensity changes in the image. Sharp edges, extended edges, thin lines 
or bars, and compact blobs are represented along with their attributes, such 
as orientation, contrast, and fuzziness (spatial scale) (see Figure 1.1). Edge 
assertions are constructed by parsing the output of different receptive fields 
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of local, first-order statistics of image feature attributes and densities. These 
studies have shown that texture discrimination can occur immediately (within 
160 milliseconds), before the eye has time to move. Presumably, this parallel, 
extra-foveal “preattentive” process directs the fovea to quickly scrutinize areas 
of interest within the scene (the so-called “attentive” mode of vision) [Julesz 



























and Bergen 1983]. 

Julesz has studied human texture perception using synthetic images, usu¬ 
ally composed of dots or symbols. Originally, he proposed that textures hav¬ 
ing identical second-order, global statistics of image points were preattentively 
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most texture boundaries correspond to intensity changes. Of course, the hu¬ 
man visual system might also use such an approach attentively, e.g., to dis¬ 
ambiguate conflicting preattentive cues. 

Witkin [1982] labeled intensity edges in this manner by computing the 
correlations of intensity values between lines parallel to the selected intensity 



edge. If the correlations are high on either side of the edge, but drop across it, 
the edge is due to occlusion. If the correlations remain high everywhere, but 
the regression parameters are offset across the edge, the intensity edge is due 
to shadow. While this computation is implausible as a model of human vision, 
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Chapter 4 presents some psychophysical experiments that investigate which 
attributes of blobs are compared by the human visual system and how small a 
difference in attribute values is perceivable. This leads to the development of a 
texture difference statistic in Chapter 5, which answers a critical question not 
addressed by Marr or the psychophysicists, namely, How are two sample dis- 



tributions of texton attributes compared? The boundaries detected using the 
statistic accord with perception, as demonstrated by both real and synthetic 
examples. 

Chapter 6 questions the significance of terminators and crossings, proposed 
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Chapter 2 Noise Estimation 
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its maximum, as shown in Figure 2.2c. The next points on the curve at 
80% and 20% of the maximum define the extrapolation line. The actual zero 
crossing, of course, corresponds to the first local maximum of h(m ), which is 
used as the noise estimate for images satisfying the uniform region assumption. 
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containing untextured areas. In these examples, I used the edge detector of 
Canny [1983], thresholding the edges with hysteresis, using thresholds Ti = 
and 72 = 4c. In many applications, it is desirable to remove weak “real” edges 
as well, in which case higher threshold factors are used. 
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histogram of I * V 2 G and the approximating Gaussian for the image of books 
is shown in Figure 2.2a. 

The estimate of c is used in the next chapter to choose an initial level for 
blob detection. The relationship between threshold r and confidence level c is 
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Chapter 3 Blob Detection 
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has non-zero area—and thresholding the convolved image at zero [Richards et 
al. 1982], 
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Implementing such a scheme, of course, requires that cameras be calibrated. 
Most cameras have neither purely linear nor logarithmic response, suggesting 
the use of a look-up table for transforming their output to I = log b. 

lr rhis assumes that illumination changes occur at a larger scale than reflectance changes 
do. Thin shadows can cause blobs too. 
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of blobs, such regions must be segmented into localized blobs and bars. Thin 
connections between otherwise compact bars must be eliminated. Also, elon¬ 
gated regions must be separated at bends and intersections into roughly linear 
bars. Simple procedures for performing these two types of segmentation are 
described next. 
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for dark and light blobs, respectively. Assuming a step edge of amplitude 
a, the contrast at a point on the perimeter is 0 ( 3 ) = d=a/27rcr, where <7 is 
the standard deviation of the Gaussian smoothing filter G. The contrast is 
negative for dark blobs and positive for light ones. 


eo 



hO 0) 

a top 


a 

a 

ut 

tH 

ct 

A 

a 

• P*i 

A 


a 

co 

03 

fH 


bO 

03 

u 


X 

0) 


o 

A 

- 4-5 

t-4 

ct 

03 

A 

4-5 


* -a 


a 

o 


- 4-5 

o 
03 

- 4-5 
0) 

4) 
bO 
X 
0) 


t-4 

0 

£ 

a 

03 

‘a 

’> 

a 

03 

ct 

A 

-45 

<■4-4 

a 

0 

a 

0 

03 

bO 

£-1 

X 


03 

03 

>5 

-45 

• pH 

bO 

X 

03 

Cfl 

<D 

03 

ja 


-45 

ri 

03 

• pH 

X 

a 

• pH 

co 

< 

bO 

a 


^0 


'Tt 


co 


a 

a 

a 

o „ ^ 

a-\ a • 1-1 


-4-5 

a 

• pH 

O 

a, 


ct 


X 


it 


ct 


0) 

> 

• pH 

- 4-5 

it 

bO 

03 

a 

X 

§ 

m 

-a 

o 


f-l 

<t 

X 

t-4 

& 

03 

> 


C3 *33 


co 


co 

O 

CX 

co 


«5 

O 

a 

<u 

*a 

t-T 

a 

o 

-u 

a 

o 

u 

03 


t-4 

it 

"a 

0 

• ph 

X 

a 

03 

cx 

fH 

0) 

P4 


03 4) 

.2 g 

£ § 

a 

^a >> 

1 -a 

o a 

a g 

.BP £ 

CO • ^ 

- 4 . W 

a to 

If *-H 

• r/3 

CO 

o b0 

CX O 

o -3 


X* 

§ 

t-T 

a 

o 

- 4-5 

a 

o 

o 

to 

a 

o 

• rH 

fn 

a 

cx 

co 

it 

-45 

a 

CO 

-a 

o 


- 4-5 

-a 

bO 


fH 

.O 


it 




CM ,jQ 


to 


Vy' 


co 


C4 

b 

00 


r (O 00 


CO CO 


03 

Sh 

it 

CO 

it 

03 

it 

03 

CO 

O 

^a 

£ 


^ H 

X. 


a 

o 

-4-5 

a 

o 

o 


0) 

A 

■+5 

^ 4-4 

o 

o 

to 

-4-5 

co 

a 

-4-5 

it 

bO 

a 

JD 

'"it 


co 

0) 

t-4 

a 

b0 


a 

ct 

-a 

-4-5 

CO EXi 
co 

4) 

■ 03 

CO 

• pH 

O 

a 

CO 

ct 

X 

03 

X 

t-4 

it 

o 
co 


- fe 


CO 

03 

a 

0> 

O 

co 

^lt 

fH 

a 

-45 

a 

a 


^ ^ X 


CO 

-O 

O 


a 


o 

CO 

^it 

03 

t-4 

it 

a" 

o 

• ^h 

+3 

03 

03 

-4-5 

03 

X 

o 


o 

03 

r —H 

ct 

u 

co 

03 

aa 

-4-5 

CO 


03 

(-4 

03 

-a 

£ 


1 

03 
.03 

’a* 
o 

03 

a' co 


03 

t-4 

a 

b0 


O 

. t-4 
<4-4 

X 

03 

-45 

03 

03 

-45 

03 

X 

co 

-a 

o 


co 

03 


s 

a 

x 

a 

03 

t-4 

o 

6 


N 

CO 

03 


O 

-45 

^03 

a 

a 

x 

03 

f-4 

03 

- 4-5 

a 

a 

o 

03 

-45 

-8 

e 

o 

X 

a 

a 

t-4 

a 


o, x 

■ 03 


4-5 

03 

03 

-45 

03 

X 

co 

-a 

o 


A 

-M 

• PH 

u 

O 

JM) 

"a 

a 

o 

• pH 

03 

03 

- 4-5 

03 

X 

A 

o 

A 

0-4 

o 

co 

• ^ 
CO 


£ 

A 


>> 

0 

A 

A 

fH 


pH 

a 

#*H 

CO 

it 


a 

t— 

X 



CO 

X 

CO 

£ 

O 

03 

tH 


a 

A 

a 

• 

ct 

co 

-4-5 

eo 


The proposed blob segmentation scheme is less biologically plausible than one 
which employs oriented feature detectors of various sizes and orientations (as 
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I conjecture that texture in natural scenes can be represented using blobs 
(as detected by my algorithm) and their attributes. This proposal contrasts 
with most implemented feature-based computations of texture, which employ 
edges. I claim that blobs are more useful than edges for representing tex- 
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tween threads in a fabric, or gaps between leaves on a tree manifest themselves 
as small dark regions in the image. Less light is reflected from such surfaces 
because of shadows cast by objects nearer the light source, or because of the 
oblique angle of these surfaces with respect to the viewer. Even surface mark¬ 
ings, such as type on a page, are more often than not dark on light, resulting 




in isolated dark blobs. 

How to automatically choose the appropriate scale for blob detection (<r) i 
not addressed here. One approach is to compute blobs at multiple scales, an< 
integrate them into a single description, as Canny [1983] suggested for edges 
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Chapter 4 Perceivable Differences in 


CO 



actly what kinds of changes in size, orientation, and density of blobs are per¬ 
ceived. One purpose of the experiments was to measure, for each attribute, 
the minimum magnitude of attribute change perceived as significant. Another 
goal wfts to infer from these minimum perceivable differences which, among a 
set of interrelated attributes, are compared by the human visual system. 



The experiments employed synthetic images composed of filled-in rectan¬ 
gles or ellipses of varying dimensions, orientations and spacings. Each image 
consisted of t wo - di stri b u tion s of textons, one distribution per region. Usually, 
the attributes of textons were normally distributed in each region according 
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For each type of attribute change investigated, a series of images was used, 
with different magnitudes of change in each. Each such set of images investi¬ 
gating a particular kind of attribute change constitutes an experiment. During 
any one session, the subject was shown images from several experiments, in 
random order, so he would not become tuned to the type of changes being 
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certainly is. Rectangles were used in the orientation experiments since their Figure 4.1 Orientation differences of 15 

orientations seemed more salient than those of ellipses of the same dimensions. or more are preattentively perceivable. 
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Experiment 2. The next experiment investigated the effect of non-zero vari¬ 
ance on orientation discriminability. In each image, the standard deviations of 
orientation in both regions were equal. Orientations which differ by 15° remain 
discriminable up to standard deviations of about 5°, as shown in Figure 4.2a. 
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I assumed that size and density comparisons were scale-independent, and 
hence, that critical differences should be expressed as ratios rather than as 
differences of the attributes. For consistency, I express such ratios as values 
greater than one. It is often more convenient to use the logarithms of the 
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sured by keeping length proportional to width. For both elongated (elliptical) 
and compact (circular) blobs, a minimum perceivable area ratio of 1.25 (to the 
nearest 0.05) was obtained; this difference is shown in Figure 4.7. It seems, 
then, that the width and length results obtained in Experiments 5 and 6 might 
alternatively be explained by significant differences in texton area. 
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Experiment 9. With a log width difference of Aw = — log 1.15, the minimum 
positive difference in log length was measured. The critical difference, shown 
in Figure 4.10a. is approximately Al = log 1.30. Distributions with differences 
Aic = — log 1.10 and Al = 1.30 were also found to be discriminable. 
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Experiment 12. In this experiment, the texton area density was varied by 

Figure 4.12 The minimum perceivable 

varying both texton number density and texton area in the same direction, difference in texton number density, with 

i.e., An = Aa = Aa/2. The minimum texton area density ratio perceiv- areas held equal, is about 1.30. 
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Experiment 15. The texton number density was held at 1.15, while the area 
ratio was varied in the opposite direction. The minimum perceivable texton 
area ratio was about 1.30, as shown in Figure 4.146. 
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about 1.25, or when the ratios of texton area exceed about 1.30. These con¬ 
clusions are based on the assumption that density comparisons are not biased 
with respect to changes in texton width or length. Geometrically, I assumed 
that the bounding planes in Aw-A/-An-space are perpendicular to the plane 
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Experiment 1 7. The minimum difference in width was measured varying tex¬ 
ton number density with width, i.e., An = Aw, as Al = 0. Again, width ratios 
of 1.25 or more were perceivable, as shown in Figure 4.166. 



05 


to 

••■H 

-4-0 Ql 

HD -Q 

3 a 

3 

§ « 

i § 

*» * 
~, CD 

§ ~ 
S - 

^ 3 

CD 
*2 

£ 

CD ■"■' 
Fh HD 
3 CD 

b©’G 

r~* «S 
&D > 


iSIs^S 

rr ”n Cl b- ••— 


"S 

3 c« 


co 

£ 

CD 

HD 


dO 

4—I 


-40 

d 

-£ 

-40 

o 

co 


-£ 


d 

a -a 

* 3 

§ « 

so -cj 

* 

<D 

So 


I- 

&*g 

d ccj 

co ^ 

'" i CO 
Q) •"I 


-4-0 

£ 

03 

-44> 

CO 

d 

o 

CJ 


-O 

2 

5 

CJ 

6 


•d 

So 

hd 


•2 St 


s r co 

co g 

d S 

-2 ® 
HD «H 


2 

*d 

-4o 

HD 


•d 

-4-0 

hd 

a 

3 


d FO 

a *1 

d r-n 

2 H3 

*S d 

0 d 

>4 O 
-4H t-l 

'co ^ 
d o 

CD CO 


d 

d .« 

"a -2 

3 •+* 
d CCS 

d «H 



CO 
+o 

d 

CD - _ 

a £ d 
•§ <1 

x g 

fc} d 


d 

Oh 

a 

o 

CJ 

CD 

«H 


i—i cr w 

O >| in 

So So ^ 

•g « 8 

fn so II 
CQ li 

2 P d 

pd £0 d 

Eh b© <1 

co d 
’ i In. d 

^ ^ Is 

CD ”£ (L, 

d d 3 

£ S 2 


\ h ^ \ 'V\WNO\\\U 

\\yU\Uv 

\ ' x % x i \ \ 

'V X , ' 'x XX 


VM \ \ 


'> >> \ x N ' v >;C\;., 

V ^\'\Ivx' V '"""XX 

X X \ X s X X X t X X x X X X x X X 
X Xx X xx X X Xx\XXxxXX| 

X X X X X XX XX X X X X X X X XX 

' XxxxX xxxxxxx xx \ x x 
X X X x 'X X x Xx x{x xx x'xX 
x'x XX XXvXXXXXxXXx 
XxXXy XXX XXX xx xx'xXx' 
x I X % | X X x x X X x X x X x x X x 
X X X X X x x X X X X X X X x XX x 
XXX X X X X'xxx XXX XX X X x 
X XX XX XX XX 'x "'XI S\ 
XX^XxXX XX X X X ' Xx X X X X 
x X X v \ X X X \ N XiXXx\*XX 
XX X X x X x x X xx X X XX X X X X 
Xx'XXXXxxXX|XXXX\XX 

xxxxxxxxXxxxxxxxXxx 

XXXX\XXXXXXX'XX\\XX 


X x X X JXX xx X XX XX XX X x X 

xx" XXXxxXxxXXxXx xXX 
XXXX.XX1 yxyxxxxxxxl X 
XxXXX XX XVXxXx'XXXXxX 
x X X x X XXX xx Xx X X X X X X X I 
xXXX X x X ^ XxXXXX XA . k 1 
\l xy x» X'XVXX X\ XxX>x 
xx XxXxx Xv I I x XXXXXX 
X XXXIXI'X x»x X xx Xxxx 
M XlxX\X\x*X|l Xx III 
XX|XX\XXXX«X xX x x % xx 

X \\ \ \ y N \ \ ' X IX IX Xx X 

xJix"xx\V;;xx XIXXX X 
XX XXXXX x x X XX XX I X XXX 

X XI XX X x XX X XX I XX xl X I 

I x'xx I l|X x x X x X X \ |X X 

X X x V |X lx I X x x X X X X I x x 

x I X x X X XIXXXl X' XXI XX 
' I 'I Ixx Ixy | Xx' I X| Xx 


F—l 

D 

rd 

43 

d 

Fh 

rx 

e 

HD 

d 

d 


-4-3 

d 

rd 

+3 

co 

CJ 


d 

-43 

d 

hd 

"d 

-4-3 

d 

CJ 

a 


X 

CJ 

CJ 

^3 


CD 


-1-3 

HD 

CD 

d 

s 

o 

CD 

CD 

d 

d 


CO 

—H 

a -d 

a t! 


o 

.fH 

<4-1 

d 

-4.3 

d 

HD 

CJ 

M 

Eh 


f—I 

CJ 

Cd hd 


CJ 

CD 

d 

CJ 

HD 

• ri 
> 
CD 

CJ 

> 

CO 

d 

d 

CO 

t-4 

0) 

a 


CD to 
CJ 


CJ 

-4-3 

d 

CD 


o 

CD 

<D 

Fh 

d 


> 

o 

S-4 

CD 

HD^ 

CD 

M 

o 

X 

CD 

CO 

CJ 

d 

d 

o 

£ 

-4-5 

f-i 

<D 

-d 


d 

d 


DC 

d 

a 

d 

CO 

CD 

F-4 

P-. 


HD 

d 

d 

s 

<-w 

o 

CO 

d 

o 

CO 

• f-H 

t-4 

d 

CD 

a 

o 

o 

HD 

d 

d 

CO 

d 

o 

• F-H 

-4-3 

d 

-4-3 

d 

d4 


CO 

-4-3 

CO 

CD 

bo 

bo 

d 

CO 


d 

CO 

ID 

f-4 

D 

M 

Eh 

CO 

-4-9 

CO 

D 

F-h 

CO 

d 

o 

b0 

^d 

d 

d 

3 

1j 

• rH 

3 

3 

o 

HD 

d 

d 

£ 


"O 

d 

d 

D 

N 

• 1-4 

CO 

F-h 

3 

CO 

D 

F-h 

d 

CO 

d 

D 

a 

D 

-4^ 

d 

• fH 

Fh 

CD 

o 

Fh 

CD 

CD 

d 

D 

nd 

-4-3 

HD 

D 

cd 

-4-3 

d 

D 

HD 

• 

HD 

D 

D 

HD 

d 

• 

FO 


m 

D 

O 

d 

D 

Fh 

.D 

to 


D 

d 

D 

CD 

co 

d 

d 

co 

D 

CD 

<-4-H 

Fh 

d 

CO 

D 

nd 

H-3 

-43 

d 

o 

d 

d 

d 

o 

3 

a 

Fh 

.O 


b© 

d 

• r—H 

Fh 

D 

> 

O 

CD 

D 

Fh 


co 

d 

D 


d 

o 


D 

d 3 

D 

§ 

d 

d 

d3 

-43 

D 

-4-3 

d 

d 

• rt 

Fh 

-4-3 

3 


D 

co 

d 

D 

Fh 

O 

a 

d 

CO 

D 


HD 

d 

d 

o 

Fh 


D 

d 


-e SP d 


o 

d 

d 


d 

o 


o 

co 

a 

rd 

-43 

• r'H 

Fh 

d 

b0 

O 


D 

O 

d 
D 
Fh 
, D 

to 


-43 

CD 

D 

q=3 

D 

Fh 

d 

o 

r—H 

d 

<-M 

O 

D 

Fh 

d 

CO 

d 

D 

a 

-4-3 

d 

D 

HD 

d 

D 

CD 

D 

HD 

d 

• F-H 
I 

d 

o 


HD -d 


-4-3 

d 

d 


3 _5 

« d3 


.x'Mx'i'" *" ** 

\XXXX XX|X 


> x X x X XX XX y x x % x 'll XX 


c3 


►H 

d 

bO 

£ 

D 

dS 

a 

o 

bO 

d 

1 

FO 

o 

• »-H 

S-H 

HD 

flj 

-43 

d 

• pH 

HD 

• pH 
> 

d 

o 

• pH 

d 

d 

• F-H 

d 

• F-H 

d 

+ 

a 

Fh 

o 

-43 

a 

o 

to 

CD 

-43 

d 

D 

HD 

j> 

3 

> 

d 

• F-H 

CO 

43 

d 

CD 

a 

fl 

• pH 

a 

• pH 

Fh 

w 

u 

G 

rt 

d 

O 

CD 

HD 

d 

d 

O 

Fh 

CD 

43 

CO 

s-^> 

CD 

CD 

CO 

d 

CO 

ID 

HD 

• F-H 
> 
O 

£ 

o 

£ 

CO 

-43 

d 

D 

+3 

d 

• f-H 

Fh 

CD 

CD 

CO 

• pH 

*a 

-4-3 

CO 

d 

Fh 

43 

• pH 

HD 

Fh 

CD 

rd 

CO 

CO 

1 

a 

3 

CO 

D 

CD 

aj 

HD 

jH 

qj 

a 

• ^H 

(_. 

Oh 

X 

W 

HD 

>4 

43 

p 

i-3 

o 

rd 

-43 

d 

o 

CD 

QJ 

d 

bO 

• pH 

CO 

< 

d 

Fh 

d 

• ^H 

pH 

OJ 

43 

• pH 

CO 


a 

rQ 

f-S 

c$ 

a 


d 

D 


CD 

d 

d 

Tf 

o 

o 


|-5 


rd 

-4-3 

d3 

43 

to 

X 

OJ 

rd 

-43 

<d 

HD 

• 

£ 

3 

VJ 

<3 

PS 

• pH 


d 
d 

a 

d 

d 

<4H 

o 

co 

-43 

d 
D 

a 

D 
Fh 

d 

CO 

d 
D 

a 

co 

3 

CD 
D 

PQ 

dS 

-43 
• rH 

3? oo 

D 05 

U rH 

d ^ 

CO ^ 

HD 
d 

o 

CD 
co 
D 
Fh 
Fh 

o 

CD 


CO 

• r-H 

d3 

-4-3 


CO 

D 

Fh 

d 

d 

cd h 

CO 


co 

D 

bO 

d 


D 

rd 

-43 

d 

>4 

CO 

bO 

d 

• F-H 

CO 


D 

rX 

CD 

D 

ffl 

d 

.2 

3 

d 


§ 3? a 

r* inn • h 


bO 

d 

• »“H 
-43 

co 

D 

Fh 

D 

-4-3 

d 


Fh 

CD 

CO 


-4-3 

CO 

d 

Fh 

-43 

d 

o 

CD 






he and his associates found that the Rayleigh contrast function closely de- 
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compensate for decreases in size. They note that the result is consistent with 
the computation performed by spatial frequency channels. With respect this 
proposal, their result suggests that texton maps from different scales are not 
integrated into a single map before detecting texture boundaries. Hence, the 
use of textons at a single scale, as implemented here, may not be unrealistic. 














The psychophysical experiments presented in this chapter offer answers to two 
questions: 




date, age 25, with corrected-to-normal vision. The subject was not naive as to 
the purpose of the experiments. (However, for any particular test image, the 
type and magnitude of texture boundary, as well as its location, was unknown 
to him.) More extensive and more controlled experiments should be performed 
to obtain more precise estimates of “average” performance. 



Nevertheless, the minimum perceivable differences are compatible with pre¬ 
viously reported results. Schatz [1977] reports that differences in dot density 
of 20 % are perceivable, close to my figure for texton area density (20 or 25 
percent). The existence of orientation channels which span roughly 15° is also 
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One might object that the experiments above ignore the role of spatial filtering. 
In particular, the results are based on the assumption that the blobs detected 
by the visual system match the textons of the synthetic images. Because the 
textons are elliptical and fairly well isolated, at small scales of filtering (relative 
to the blob size) this assumption is valid. Figure 4.18 shows elliptical textons 
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A blob or edge is not perceived as a texture element unless it lies in a field 
of elements which is sufficiently dense. Julesz [1986] determined that for com¬ 
pact elements to be perceived as textons, the spacing between them should 
not exceed twice their diameter. Local computations of density, then, may 
serve two purposes: First, to detect density boundaries, and second, to deter- 
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The discovery that minimum perceivable differences depend on single at- 




tributes, and not combinations of them (other than those attributes so defined) 
are consistent with Treisman’s results. They too suggest that preattentive 
texture discrimination is based on the independent comparison of texton at¬ 
tributes (except for the possible interaction of contrast and width, mentioned 
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comparison of attributes of textons lying in neighborhoods on either side of 
a line segment. The last chapter presented evidence that each attribute can 
be treated independently. The problem of identifying texture boundaries can 
therefore be posed as the question, How are two sample distributions of texton 
attribute values compared? 



The comparison of two sets of samples to determine whether they are from 
the same distribution is a major subject of statistics. However, the standard 
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not “what” texture boundaries occur [Julesz 1986, p. 245]—this strategy seems 
unnecessarily complex. A non-parametric approach is more plausible. 

However, most non-parametric and parametric tests suffer from another 
problem: sensitivity to texture gradients. A systematic change in attribute 
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Capability 3: A two-valued distribution is not usually distinguishable 
from a uniform distribution. 
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The question of texture boundary detection now becomes, What statistic 
is used to compare two histograms of texton attributes? I propose using the 
statistic, 
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and assuming R( 0) = 1, Capabilities 1-4, imply the first four of the following 
constraints: 
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Empirically, he determined a threshold for the statistic. However, the sum of 
frequency differences (SFD) statistic is not consistent with the psychophysical 
results obtained here. In particular, it does not account for Capability 4 — 
the fact that sharper modes at different locations are more discriminable than 
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At each point, the maximum difference over configurations of neighborhood 
pairs at all orientations is desired. This value can be computed from the MFD 
statistic measured in two directions (x and y), by assuming that the texture 
edge is locally linear. The next section describes the exact computation and 
an approximation to it. 
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In real images texture boundaries occur at different scales. This is due to two 
factors: First, the spacing of textons varies. Second, the width of a transition 



























































































between two textured areas varies. 

Julesz [1986] measured the upper limit on texton spacing. He found that 
compact textons were perceived as a texture provided that they were sepa¬ 
rated by no more than twice their diameter. At the other extreme, textons 
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a frequency distribution having fewer than 4 textons is reduced by 1/4 for each 
texton lacking from the smaller neighborhood. It would probably be better, 
especially for larger neighborhoods, to include in each sample distribution only 
those textons having nearby neighbors, computed using the discrete Voronoi 
diagram discussed in Section 4.5.2. 


















































































































5.3.4 Applicability of MFD statistic to other attributes 
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neighborhoods. 

If individual attribute boundaries are not detected explicitly, this would 
imply that subjects are not aware of the types of texture boundaries from 
preattentive viewing. It would be interesting to perform some psychophysical 
experiments, in order to possibly reject this hypothesis. 
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directly from the blob pixel map, and an edge detector applied to the result. 
This method of texton area boundary detection does not require the symbolic 
representation of the primal sketch or the algorithm for attribute comparison 
which explain the perception of other attribute boundaries. Figures 5.8 and 
5.9 show boundaries detected using this method. 



























































It is possible that area density boundaries are computed instead of contrast 
boundaries. Since the response of I * V 2 G is proportional to the contrast of the 
blob, some contrast boundaries will manifest themselves as density boundaries 
if the proper level is chosen. 
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. At each scale, histograms from adjacent neighborhoods are compared. 
The maximum difference in frequencies over all buckets is computed. 
The MFD statistic, which ranges from 0 to 1, measures the texture 
difference between the two neighborhoods. 
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images. Although each of their theories is based on the premise that first 
order differences in texton attributes are compared, each offers some unique, 
if sketchy, ideas about how this is done. The next chapter shows how some 
observations of Julesz can be reinterpreted in terms of the theory proposed 
here. Below, my proposal is related to particular ideas of Marr and Beck. 
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this phenomenon, Beck et al. [1983] propose that texture boundary detection 
is suppressed if the density of strong difference signals is high. Their expla¬ 
nation would therefore require a mechanism whereby difference signals are 
attenuated by the presence of strong, non-colinear signals, or by suppressing 
texture boundary detection in regions where the density of signals was high. 




Beck’s proposal apparently rests on the assumption that simple differences 
between texton attributes (or perhaps means of distributions of texton at¬ 
tributes) are computed. Our theory accounts for this phenomenon as part of 
the computation of the MFD statistic over neighborhoods of reasonable size. 
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Chapter 6 Terminators and Crossings 
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1 Rearick [1985] has implemented a similar computation, detecting terminators and cross¬ 
ings in natural images using endpoints and junctions of the skeleton obtained by contrast¬ 
enhancing, thresholding, and thinning the image array. 
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boundary (Figure 6.2c)> Again, crossings are not required as an explanation. 

It would interesting to repeat the psychophysical experiments involving 
crossings, lowering the contrast of the +’s so that no contrast boundary would 
be detected. If the regions were not preattentively discriminable, this would 
disprove the conjecture that crossings are textons. 
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Figure 5). However, a texture boundary is not preattentively perceivable. In 
this case blobs computed at the same scale as the previous example have similar 
contrasts and geometric attributes, as shown in Figure 6.3b. In this example, 
blob attributes better account for texture perception than do terminators. 

The examples above show that Julesz and Bergen’s demonstrations of ter- 
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distinctive number of terminators or crossings. It is not surprising then, that 
the simple blob attributes, whose relevance to natural images is demonstrated 
in Section 5.3, better account for perception in the artificial examples as well. 
Julesz and Bergen recognized that a precise definition of terminators for blobs 
having significant width was problematic, and concluded, “we are not certain 
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experiment concerned “pop out” phenomenon—the immediate xecognition of 
textons which differ from their neighbors—it has implications for preattentive 
boundary detection as well. For texture vision, it suggests that a field of tex¬ 
tons having two terminators each is preattentively distinguishable from a field 
of textons having none. 









An example directly concerning texture boundaries, and perhaps more rel¬ 
evant to natural images, is shown in Figure 6.5. Here, the perceived texture 
boundary can probably only be accounted for by a difference in terminators. 
The widths, orientations, and density of bars on each side is the same. The 
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psychophysical evidence has been presented to suggest it. Treisman’s pop out 
tests, in fact, indicate that crossings are not preattentively perceivable [Treis- 
man 1985]. It is also worth noting that Marr [1976a, b] mentions terminations, 
but not crossings, as assertions of the raw primal sketch. 

In summary, the geometric and luminance attributes of blobs seem more 



relevant to natural images than do crossings or terminators. Psychophysics 
indicate that differences in these attributes which cause texture boundaries 
(around 25%) are small compared to terminators, which require much larger 
ratios. 
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Chapter 7 Conclusion 
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Consider an orientation boundary. If each of the orientation distributions 
on either side of the edge consists of a single sharp peak located at different 
means, the boundary may be due to a change in surface orientation. But if the 
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model of this process is sketched here. 

At each boundary of interest, the textons on either side of it are iden¬ 
tified by constructing a window alongside the boundary. The windows are 
drawn as strips parallel to the boundary on either side of it. Choosing the ap¬ 
propriate window sizes is important. Each window must be sufficiently large 
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constructed of the attributes of the textons lying in each window, defining the 
sample distribution functions to be analyzed. Figure 7.1 shows an example. 

The distributions of texton attributes are described symbolically using 
an algorithm written by Carlotto [1984]. The procedure identifies Gaussian- 
shaped modes, which may overlap, in a histogram. To accomplish this, the 
























histogram is smoothed and differentiated twice. Pairs of zero crossings of the 
second derivative determine the initial estimates of the locations and widths of 
each mode. These estimates are refined using a maximum likelihood technique. 
Each mode is described by its position (mean), width (standard deviation), 
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. Difference in intensity, but similar in all other attributes, i 
trast: Shadow. 
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text, texture can be regarded as a cue for labeling an intensity edge directly 
according to its physical origin—a discontinuity in surface depth, orientation, 
reflectance or illumination. Such a hypothesize-and-test strategy resembles 
Witkin’s correlation approach to intensity edge labeling [Witkin 1982], de¬ 
scribed in Section 1.1.3. 





Figure 7.2 Interpreting intensity edges. boundaries. Facing page: Histograms of 
(a) Large scale edges of image books to the orientations of texton edge pixels on 
be interpreted, (b) Here, fine scale either side of each edge (shown in c) are 

(o — 1.5j intensity edge pixels are constructed, analyzed, and compared to 

employed as textons. (c) Selected long, interpret the physical cause of the edge. 
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This problem may be resolved by separating the task into two stages, as 
the human visual system apparently does. Preattentively, a non-parametric 
statistic like the one proposed can be computed in order to locate texture 
boundaries approximately. Since it employs small neighborhoods, it can be 


b- 

o 


X 

• iH 

'P 

O 

£ 

-43 

£ 

O 

-P 

<H-I 

. f-H 

o 

p 

a 

X) 

-43 

O 

p 

§ 

o 


0 

XI 

5-1 

XI 

-43 

p 

-O 


5-H 

,P 

*H—i 

a 

• rH 

o 

-43 

p 

o 

• rH 

3 

a 

5-H 

.o 


X 
bO 
P 
o 
p 
p 

p 

• rH 
> 
O 
5-1 
PH 
x 

& 
£ 

-43 

O 

P 

X 
P 
O 
H3 

-4-3 

• rH 

P 

o 
p 
a; 

ffi 


P 

• rH 

O 

£ 

p 

'a; 

> 

• I—H 

-4-3 

<ti 

~p 

5-4 

*P 

P 

-43 

P 

Oh 

fi 

O 

o 


f-H 

,P 


xi 

P 

O 

• rH 
- 4-3 

p 

X 

• rH 

5-4 

-43 


P 

-43 

P 

-O 


-43 

d 

a; 

-P 


5h 

d 

*P 

P 

P 

O 

X 

P 

5-4 

p 

- 4-3 

X 

p 

-43 


p 

•q 

p 

hP 

-43 

-43 

P 

o 

-O 

P 

P 

O 

• —H 
-43 

ci3 


5h 

O 


O 


p 

XI 

P 

P 

p 

'cS 

O 

• rH 

03 

4^4 

Pi 

Oh 

P 

X 

-43 


*H-l 

^P 

P 

-43 

p 

o 


P 2 

.1-4 • 1-1 


p 

bO 

P 


3 "g 

rP g 

U g 


P 

-P 

-43 

P 

P 

P 


0 .5 


zn 


'•a 

p 

XI 

p 

XI 

• rH 

P 

'•a 

o 

a 

p 

> 


p 

p 

5-h 

Oh 


d 

-43 

-O 

o 

Eh 


-4-3 

p 

p 

-43 

-43 

d 

P 

d 

P 

o 


-4-3 

p 

1-0 


xi 

■ rH 

-O 


i 

5h 

P 

-43 

P 

d 

5h 

d 

X 

P 


K*4 

<s 


5-1 

P 

Oh 

P 

-0 

-43 

5-1 

£ 

'P 

P 

P 


a a 


p 

-O 

S 

p 


p 

f-i 

d 

P 


P 

d 

-P 

-43 

XI 

P 

bO 

§ 

J3 

P 


P 


P 

XI 

O 

O 4 X 


P 

XI 

P 

5-1 

O 


P 

o 

» rH 

P 

P 




a> 

to 

£ 

jO 

’IS 

X! 

• rH 

X 


bo EH 

5-4 


> 

• rH 

r—H 

P 

5-h 


X 

P 

o 

• rH 

P 

i-Q 

• rH 

5-4 

-43 

x 


1 

"P 

P 

P 

O 

X 

p 

-p 

-43 


p 

o 

• rH 

-43 

-43 

P 

5h 

Oh 

5-1 

P 

-43 

P 


.P 

*X ~5 

Oh ^ 

4*4 . ,_4 

X 
5-4 

P 
-P 

-43 

• rH 

P 

P 

O 

X! 

P 

o 

• rH 

-+3 

P 

-Q 


'P 

P 

N 

• rH 

5-4 

P 

-43 

P 

5-h 

d 

X 

p 

P 

5-h 

ft 

5-4 

«3 

'P 

P 

P 

O 

-O 

p 

X 


xi 

-43 

• rH 

a 

p 

Oh 

P 

P 

> 

• rH 

P 

p 

-43 

-43 

c<3 

P 

5h 

Oh 




P 

-P 


P 

-43 

d 

5-h 

P 

P 

P 

d 


p 

X 

-43 

bO 

P 

• H 

N 


xi 

X2 

O 

Oh 

X 


P 

O 


x 

O 

Oh 

P 

-P 


O >; 'P ju p >; 


p 

p 

P 

o 


5h 

d 


p 

> 

• rH 

-43 

P 

P 

-43 

-43 

d 


P 

o 


x 

P 

d 

5-4 

-43 

p 

X 

-43 




p 

-43 

• rH 

■P 

P 

s 

s 

• rH 

P 

X 

-43 


x 

P 

O 

-43 

X 

p 




x 




P 


X 

p 

"p 

• rH 

X 

43 

3 

> 

X 

O 

p 

5-4 

Pi 

Oh 

b-i 

X 

O 

p 


• rH 

5-1 

>> 

d 

Pi 


d 


P 

O 

» rH 

CO 


a 

a 

0 

ZD 

rt* 


For over a decade various scientists have proposed that texture vision oper¬ 
ates by detecting first-order differences in the attributes of texture tokens. 



This research, for the first time, has explained some of the details of such a 
computation—details which are crucial to demonstrate the applicability of the 
theory to images of natural scenes. 

Below, I summarize the main results of this research and describe their 
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Chapter 5: A minimum difference statistic was proposed which accounts 
for the large variety of preattentively perceivable texture boundaries. 
The statistic, which is biologically plausible, successfully locates texture 
boundaries in natural scenes. A similar computation might serve to 
locate color and motion discontinuities (see Spoerri and Ullman [1987]). 



Chapter 6: The role of terminators and crossings as textons was chal¬ 
lenged, by showing that purported demonstrations of their salience are 
better accounted for by attributes of blobs. It was conjectured that only 
changes in terminator density higher than previously suggested could 
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